CFM03244/P203-0384 



TITLE OF THE INVENTION 
REMOTE CONTROL OF IMAGE PICKUP APPARATUS 

FIELD OF THE INVENTION 
5 The present Invention relates to a technology of 

remotely controlling an image pickup apparatus in a 
system for delivering images sensed by a camera over a 
network . 

10 BACKGROUND OF THE INVENTION 

There has been provided a system which allows 
multiple people to see an image sensed by a camera 
provided at a remote location via a network, as well as 
enables the people to remotely control the pan and tilt 

15 angles or zoom magnification of the ceimera. For 

example, there has been developed a system which, by 
connecting a computer- controllable camera via a WWW 
server on the Internet to a personal computer also 
connected to the Internet, not only delivers real-time 

20 images taken by the camera to a user who has accessed 
to the system but also allows control of the camera 
(see Japanese Patent Laid-Open No. 10-040185, for 
example). The image- delivering side and the image- 
viewing side are in a server-client relationship. 

25 In such a system which allows controlling of a 

camera and delivers images to multiple people at 
multiple locations, operation and observation are 
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assumed to be performed by an unspecified number of 
users (Clients). When a camera (server) is controlled 
by many people, authorization to control the camera is 
important (see Japanese Patent Laid-Open No. 10-042278. 
5 for example) . A client who has acquired the 
authorization can control the camera. The 
authorization is released when a predetermined time 
period has elapsed. 

in such a system, multiple levels of authorization 
10 are provided, and a higher level user (client) is given 
higher priority authorization when the user (client) 
controls the camera. It is disclosed that a different 
authorization time period is given to each of multiple 
priority levels (see Japanese Patent Laid-Open No. 10- 
15 164554, for example). 

such a system is not only used as a Web camera 
system, e.g., for the purpose of delivering appearances 
of Sightseeing spots and roads and the like to an 
unspecified number of people over the Internet, but 
also often used as a security camera system, e.g., for 
the purpose of delivering images to particular people 
for crime prevention and the like. 

When such a system is used for monitoring for the 
purpose of crime prevention, the image is not always 
25 seen by someone. Accordingly, in a conventional 

general monitoring system using an image, the image is 
continuously recorded so that the recorded image may be 



20 
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later checked In case any atoo«»aXlty happens. 
.Xternatively. by detecting an abnonoallty -actions 
of an image, the i.nage is recorded or ahnomality 
detection information is notified only when such an 
abnormality is detected. 

in such a system allowing multiple people at 
multiple locations to view an image and enabling only 
one user at a time to control the camera by giving 
authorization to hi^/her as described above, the system 
.aministrator and a person who controls the camera are 
not always the same. For example, a camera may be used 
.s a web camera for delivering i^ges to an unspecified 
number of people via the Internet during the day. and 
as a security camera directed to a particul«: direction 
for monitoring to detect an abnormality, such as 



15 

trespass 



20 



25 



in this case, there is a possibility that an 
abnormality cannot be detected because an unexpected 
Client has accessed the system and freely controlled 
the camera. Especially, when the camera is set to 
.ecord abnormity detection results in an unwatched and 
automated operation, if the camera is controlled to be 
Changed and fixed to face a direction different from 
the direction to be monitored or a different .oom 
^gnification. it cannot perform the predetermined 
abnormality detection, and this may cause a serious 



problem . 
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SUMMARlt OF THE INVENTION 
The present Invention has been made in 
consideration of the above situation, and Its object is 
to prevent a camera from being controlled from a 
terminal other than a predetermined terminal during a 
particular operation thereof. 

According to the present invention, the foregoing 
object IS attained by providing a control method for 
controlling an l^ge pickup apparatus In an image 
delivery system that delivers an Image acquired from 
the image pickup apparatus to at least one of multiple 
external devices, the Image pickup apparatus being 
remotely controllable by the multiple external devices, 
the method comprising: controlling the image plcXup 
apparatus at a preset time based on preset control 
data; and inhibiting remote control of the Image pickup 
apparatus by a predetermined external device during the 
control performed based on the control data. 

According to the present invention, the foregoing 
object IS also attained by providing an Image delivery 
apparatus that delivers images acquired from an image 
pickup apparatus to at least one of multiple external 
devices, the Image pickup apparatus being remotely 
5 controllable by the multiple external devices, the 
image delivery apparatus comprising: a data storage 
medium that stores control data to control the image 
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apparatus ana a start ti^e to start control 
„s^. the control data, a sCednXa execution unit that 
starts control o. the l^ge plcKup apparatus hased on 
..e control data at the start tl^e: ana a restriction 
S unit that inhlhlts remote control o* the Image plcKup 
apparatus ^ a preaeter»lnea external aevlce aurlng 
control by said schedule execution unit. 

Other features and advantages of the present 
invention will he apparent from the following 
,0 description taKen 1. conjunction with the accompanying 
^awmgs. in which llKe reference characters designate 
, or similar parts throughout the figures 



the 
thereof . 



5 BRIEF DESCRIPTION OF THE DRAWINGS 

«.e accompanying drawings, which are Incorporated 
i„ and constitute a part of the specification. 
Illustrate emhodlments of the Invention and. together 
„.th the description, serve to explain the principles 

20 of the invention. 

PIG. 1 Shows a system configuration according to 
an embodiment of the present Invention, 

„G 2 IS a blocK diagram showing a configuration 
Of a camera server device according to the embodiment 
25 Of the present invention; 
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„o 3 is a .xoc. .l..ra» snowing a configuration 
a terminal according to tne e»..oai™ent o. t.e 

present invention; 

„0 4 snows an e^an^le Of an operation screen. 

„GS. 5. to 5„ snow a co^nand and a data pacHet 
.o^at according to tne e»nodi™ent o< tne present 

invention; 

PIS 6 IS a flowcnart snowing processing of 

™nt unit according to tne embodiment 
connection management unit ac 

10 of tne present invention: 

autnorlzatlon management unit according to tne 

embodiment of tne present Invention; 

„0 e is a flowcnart Of image delivery processing 

,S according to tne embodiment of tne present invent- 

PIO , IS a flowcnart snowing abnormal detection 

processing of an abnormal detection processing unit 
Lording to tne embodiment of tne present inven 
10 is a f lowcnart snowing processing 
,0 camera control unit according to tne embodiment of tne 

present Invention: .cnedule 

„GS. UA to lie snow an example of a 
according to tne embodiment of tne present invention: 
PXG 12 is a flowcnart snowing processing of 
„ scnedule management unit according to tne embodiment of 
the present invention; 
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„G 13 IS a flow^art showing processing of a 
.e^mal according to tne e».oal.ent o. tne present 
invention; 

„0 14 is a flowchart illustrating events and 
corresponding processes according to tne e..odi.ent o* 
the present Invention! and 

FIGS. 15A and 15B show an e«™ple of a set 
schedule according to a second emhodi»ent of the 
present invention. 

° .=X.XLBI> BHSCHIPTIOH OP THB PREPEHRKP BMBOOX»EN,S 

preferred embodiments of the present invention 
«ill he described in detail in accordance with the 
accompanying drawings. 

m IFirst Embodiment] 

Xn the first embodiment, in addition to a feature 

allowing multiple user to control a camera while 
delivering a real-time image to the multiple users^ 
.here is also provided a feature of controlling and 
30 fixing a camera at camera control values .combination 
Of pan. tilt and zoom, which have been preset at 

described, during a particular time period according to 
a preset schedule to perform an abnormality detection 
„ process described later and save the image when any 
abnormality happens. 
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PIG. 1 Shows a system configuration according to 
the first embodiment of the present Invention. 

m FIG. 1, the reference numeral 11 denotes a 
camera server device; 12. a general user terminal; and 
5 13 an administrator terminal, all of which are 

connected via a network 14. A camera, whose pan. tilt 
and .oom can he operated, is connected to the camera 

network 14 in response to a 
a real-time Image via the networK j. 

LO request hy the terminals 12. 13 and enables the 

terminal 12. 13 to control the camera. Furthermore, 
the camera server 11 executes an abnormality detection 
function for a particular time period specified in 
advance and saves the image in case any abnormality 

15 happens . 

Though multiple camera server devices 11. general 
user terminals 12. and administrator terminals 13 may 
be connected to the network 14. it is assumed that Just 
one for each is connected in this first embodiment, for 
.0 simplification of explanation. The network 14 may be 
„y digital network, such as the Internet and an 
intranet, having a band enough to transmit camera 
control signals and compressed image signals, which are 
described later. The network protocol used here is 
„ assumed to be the TCP/IP (UDP/IP) protocol, and the 

-address- used in the description below indicates an IP 
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terminals 12. 13 Is assumed to be assigned an IP 
address. 

Tne configuration of each of the above-mentioned 
devices is now described below. 

FIG. 2 IS a block diagram showing a configuration 
Of the camera server device 11. The camera server 
aevlce 11 IS composed of = an image sensing unit 211 
«hich uses a CCD and the like to sense an image as a 
digital l^ge Signal; a pan head driving unit 215 
10 capable of electronically controlling the pan and tilt 
angles to set an image sensing direction of the image 
sensing unit 211= a pan head control unit 216 for 
controlling the pan head driving unit 215; a camera 
control unit 217 for controlling the zoom magnification 
1, of the image sensing unit 211 and controlling the pan 
tilt angles of the pan head driving unit 215 via 
the pan head control unit 216: an image compression 
212 for compressing an Image Inputted from the 
^age sensing unit 211; an abnormality detection unit 
ao 213 for detecting an abnormality, such as trespass, 
from the Inputted image; an image recording unit 214 
for recording the image when any abnormality is 
detected; a schedule management unit 219 for managing a 
schedule of the abnormality detection function; an 
„ authorization management unit 218 for managing external 
euthorlzation to be given to the terminals 12. 13 and 
internal authorization to be .given based on the 
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scheaule; a connection management unit 220 for managing 
connection to the terminals 12. 13 for l^ge delivery 
ana camera control, and a communication control unit 
221 for controlling Image delivery to or communication 
of camera control data with the terminals 12, 13 via 
the network 14. A part of the foregoing configuration 
(the image sensing unit 211 and the pan head driving 
unit 215. for example) may be separately configured. 

The camera server device 11 captures a digital 
l^age sensed by the image sensing unit 211. compresses 
it in Motion JPEG format at the image compression unit 
212, and delivers the compressed image to all the 
conlectea terminals 12, 13. The camera server device 
11 also accepts a camera control command from the 
terminal 12 or 13 which has acguired authorization, and 
controls the zoom magnification of the Image sensing 
unit 211 and the pan head driving unit 215 based on the 
command. Furthermore, the camera server device 11 
acquires authorization based on a schedule set in 
advance by the schedule management unit 219 to perform 
camera control and operate the abnormality detection 
function. If detecting any abnormality, the camera 
server device 11 saves the image in the image recording 
unit 214. Though Motion JPEG compression is used here 
5 as the compression format of an image, a compression 
format using inter-frame correlation with a higher 
compression rate, such as H263. may be used, and the 
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present Invention is not restricted by a compression 
format . 

The configuration and operation of the terminals 
12 13 are now described with reference to FIG. 3. Two 
5 kinds Of logical channels, that is. an image delivery 
connection for delivering an image from the camera 
server device 11 to the terminals 11. 12 and a camera 
control connection for controlling the camera server 
device 11 from the terminals 11. 12 are established 
10 between the camera server device 11 and the terminals 
12. 13 as necessary. As seen from the camera server 
device 11. multiple image delivery connections can be 
established with multiple terminals, while only one 
camera control connection is established with one 

15 terminal at a time. 

m>en an image delivery connection is established, 
compressed image data delivered from the camera server 
device 11 via the network 14 is received through a 
communication control unit 31. expanded at an image 
20 expansion unit 35. and then displayed on an image 

display unit 36. The operation screen shown in PIG. 4 
is displayed on the image display unit 36 of the 
terminals 12. 13 by a display control unit 34 to allow 
a camera control operation to be performed via a camera 
25 operation unit 33. On the terminals 12. 13. there is 
operated some window system, such as Windows (TM) . 
capable of configuring a user interface screen as shown 



- 11 - 



CFM03244/P203-0384 



i„ „G. 4 on the i^age display unit 36. so that a 
soreen as shown In FIG. 4 can ha dlspXayed. 

I„ „G. 4. the reference noneral 41 denotes an 
^a.e display panel on which an l»a.e Is displayed, and 

a camera control panel for operating the centra. 
^1 pan. tilt and zoo. of the camera can he controlled 
operating scroll hars 433. 4.4. 4.5. respectively^ 

with buttons 426 to 429. Such camera control 
operations are valid only when the tennlnal 12 or 13 
retains authorization. In order to acquire 
authorization, a user first presses down an 
authorization hutton 421. In response to thxs. a 
oo,»and generation unit 32 generates a camera control 

„ authorization Is acquired, then the user can 

operate the camera. 

«.en the user ac^lres authorization and performs 
an operation via the camera operation unit 33. the 

•» mnerates a command as shown 
,0 command generation unit 32 generates 

aevlce 11 via the co^nunlcatlon control unit 31 .n 
response to the user operation. The operation Is 
described In detail later. 

PIGS. .A to 5H IS exchanged between the camera server 
device 11 and the terminals 12. 13 via the network 14. 
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strictly speaKlng. a fo«.at used tor a packet for 
TCP/IP. UDP/IP ana the like Is used. However, only 
packet l„*oo.atlon necessary for explanation of the 
first embodiment Is shown in FIGS. 5A to 5H. The 
. camera server device II haslcally operates In response 
to a request from the terminals 12. 13. .very re<,uest 
Includes IP addresses of the source and the destination. 
Each of the packets shown In FIG. to SH Is now 

described below. 
10 The camera control start request command of FIG. 

5A requests not only authorization but also 
establishment of a camera control connection to start 
camera control. An authorization level and a password 
are specified then. 
15 The camera control termination request co,™and of 

PIG. 5B requests not only release of authorization but 
.ISO disconnection of a camera control connection to 
terminate camera control. 

A camera control coMnand Is Issued while a camera 
20 control connection IS established. The pan angle 
change request command of FIG. SC. the tilt angle 
change request co^nand of FIG. 5D and the zoom 
magnification change request command of FIG. are 
Shown as camera control commands. The 6. and a 
« Shown m the figures are parameters Indicating the pan 
angle, the tile angle and the zoom magnification, 
respectively. In addition to these, there may be 
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various camera control cor^ands suO as conmanOs for 
.acK Xig^t compensation, auto-foous. nanual focus-value 
setting and the llKe. though description thereof is 

omitted here. 

The image display start request command of FIG. 5F 
is issued When the terminals 12. 13 connects tc the 
camera server device 11 to request start of delivering 
an image (Image delivery connection). 

The image display termination request command of 
PXG 5G IS for requesting termination of delivering an 
i^ga to disconnect an Image deliver connection between 
the terminals 12. 13 and the camera server device 11. 

The image data of FIG. 5H Is compressed Image data 
delivered from the camera server device 11. and an 
image Is delivered one frame hy one frame, that Is. 
each of JPEG frames Is delivered as separate packet 



15 

data. 



operations of the camera server device 11 
according to the first embodiment Is now described 
20 using flowcharts of FIGS. 6 to 10. 

FIG. 6 shows an operation flow of the connection 
^agement unit 220 of accepting a request as shown In 
FIGS. 5A to 5H (step S500). performing connection 
management and Interpretation of the request (step 
2, S510,. and then controlling each unit within the camera 
server device 11 based on the request. 
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10 



15 



,men the in>age display start request (FIG. 5F) Is 
accepted, tne source address Included In the request is 
added to an l^^e delivery destination list at step 
S511. and an in^ge delivery connection is established 
at step S512. The linage delivery destination list 
holds all the addresses of delivery destinations to 
deliver an image in a list fom«t. An l^ge is 
delivered to all the addresses specified in this list. 

Furthermore, when the image display termination 
.eque=t (FIG. 5G) is accepted, the source address 
included in the re-raest is deleted from the Image 
delivery destination list at step S521 to delete it 
£rom the image delivery destinations. Then, at step 
S522. the image delivery connection Is closed. 

«hen the camera control start re.^est (FIG. 5A) is 
accepted, acquisition of authorization is requested to 
the authorization management unit 218 at step S531. 
The authorization management unit 218 determines 
Whether or not authorization Is granted through an 
, authorization permission process (FIG. 7). At step 
S532 the result is determined and replied to the 
terminal, and if authorization is granted (in the case 
Of YES at step S533). a camera control connection is 
established at step S534. 

«hen the camera control termination request (FIG. 
SB, IS accepted, release of authorization Is requested 
to the authorization management unit 218 at step S541. 
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an* the oa^er. control connection is closed at step 



S542. 



«.en the camera control re-r^-t (FIGS. 5C to 5E, 
IS accepted. It Is detemlned whether or not the 
, terminal which Issued the re<^est Is authorized hy 
checKln, the address thereof at step SSSl. K the 

then It is replied that control Is not to he performed 
because the re,uest Is fro. an unauthorized terminal 
,0 (Step on the contrary. « the address matches 

„n the case of VES at step S552). then c».era control 
such as pan. tilt and zoon. control Is performed via the 
camera control unit 217 based on the re.juest at step 

It 1= sent to the terminal which 
S553. and then the result rs sent to 

15 sent the request at step S554. 

PIG 7 is a flowchart of an authorization 
„>3na«e.ent process at the authorization management unit 
218 in the first emhodl^nt. an authorization level 
indicating priority of authorization Is used. In this 

the higher the authorization level Is. Four levels are 
.ereln assumed with 0 as a general level. 1 to 3 as a 
scheduler level, and 2 as an administrator level. 
,^e general level Is a level of the ordinary 
„ terminal 12. and the administrator level Is a level of 
the terminal 13 for an operator with a particular 
privilege. Generally, when the camera Is used as a Weh 
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camera accessed b, an unspecified number of tennlnals. 
the level of the unspecified number of terminals Is set 
to 0. tne general level: and when used not only as a 
„eh camera hut also as a security camera, operation Is 
allowed for a system operator/administrator with the 
administrator level a authorisation. To achieve this, 
there Is provided a mechanism to enable the 
authorization level to be set higher than the general 
level for each terminal (or every time the operation 
screen of FIG. 4 is activated). For example, by 
displaying a GUI panel enabling a combination of a 
privilege level and a password to be specified to 
establish a connection only when connection is made at 
the administrator level 2. and then permitting the 
. administrator level 2 connection only when the password 
matches and the connection is authorized, the 
authorization level can be set higher than the general 
Xevel. The password may be set for each terminal in 
advance, or it may be inputted on a password reguest 
0 screen to be displayed when the operation screen of FIG. 
4 IS activated. The password may be automatically 
generated based on the unl^e address of each operation 
terminal. Instead of being specified by a user. On the 
camera server device U. it Is possible to set an 
^, authorization level corresponding to the address for 
each terminal by checKing the address. Accordingly, 
the administrator level 2 can be given only to 
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te^inals wit. P-tioula. aaa^esses. T.ere »ay be 
other .ethods for setting tne aan.inistrator level 
higher, in addition to the lin^tation based on a 
p.ssword or a ter^nal address, and an, .ethod he 
„sed only if a general level user cannot easily 
establish the administrator level connection. Xn th.s 
«„.odi.ent. a general method utilizing a password is 
assumed in the description below. 

;,s for a scheduler level, any one from 1 to 3 xs 
selected when a schedule is set. Then, according to 
the scheduler process shown in FIG. 12. which is 
described later, the schedule becomes valid at the 
selected authorization level, authorization is ac^ired. 
„d then the camera is fixed at particular camera 

« nan tilt and zoom) which 
control values (values of the pan. 

have been set in the schedule. 

The authorization level is initially set to the 

co»..and is received. Concretely, a command of «0. 
„ or =B is received. At step S603. it is determined 
Whether the co^nand is a request or release of 
authorization, if the command is a request of 
..thorization. the process proceeds to step S604 and 
acquires the authorization level ,0, of the terminal 
» requesting authorization from the camera control 

.equest co^and of PIO. ... Xf the authorization level 
,0, Of the terminal requesting authorization is higher 
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aut.o...e. te^ina. (In ..e case o. VKS at step seo., 
ana « tne passwo.. .n t.e ca.e.a cont.oX .ta.t .e..est 
cc™.an. o. .X.. 3. can .e autno.X.e. (Xn t.e case o. 
«S at step SSOM. t.en tne control connection wX . t.e 
en^entx, aut.o...e. te^XnaX Xs .o.ceax. cXose. st P 

S.0„ an. tne ca.e.a cont.oX start .e,uest co^. 

.ne ter^nax re-^estxn. autno.X.atXon Xs accepted ana 

. P is updated to Q (step 

the current authorization XeveX P xs up 

satisfied, then the camera controX start revest 
co^oand is not accepted (Step S609). 

X. the co».and accepted at step S602 is a request 
to rexease authorization, then the process returns to 
, step seOX and returns the current authorization Xe eX P 
to the xnitiaxization state, that is. 0. Xt shouXd .e 
noted that «hen the scheduXer is .orcedX, terminated 
the forced disconnection process in step SSO, .s not 

,0 '""It. there are *our authorization XeveXs in the 
,..3t e.hodi.ent. an, nu.her o. authorization XeveXs 
he provided onX. i< the nu.her is sufficient .or 
operation. 

„G 8 is a f xowchart showing processing from 
„ i».ge acquisition to deXiver.. which is to he performed 
at the camera server device XX. Necessary 
initiaXization is first performed at step S70X. and 
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t^en. an image Is acquired by fra^e fro. the i-ge 
sensing unit .11 (step S702, . The aculre* Image Is 
passed to the ahnonnallty detection unit 213 one *.ame 
one frame for abnormality detection (step S703). 
S They are also passed to the l^age compression unit 212 
Sor aPEG compression (step S704, to generate image data 
packets as shown in FIG. 5H (step S705, . The generated 

data pacKets are delivered to all the delivery 
destination addresses registered m the Image delivery 
,0 destination list (step S706, . The process from step 
S702 to step S706 are repeatedly performed. 

PIG 9 is a flowchart of an abnormality detection 
process to be performed in the abnormality detection 
unit 213. A frame of image is newly acquired (step 
15 S801). The newly acquired frame is compared With the 
i^oedlately previous frame of the image (step S802). 
If the amount of change between the frames exceeds a 
certain threshold (in the case of VES at step S804,. 
then an abnormality Is determined and notified to the 
ao image recording unit 214 (step S806,. The i»age 
recording unit 214 records the image in which the 
abnormality has been detected. If the amount of change 
is equal to or below the threshold, the image recording 
unit 214 is notified that there is no abnormality. The 
.5 process from step S801 to S807 is repeatedly performed, 
.ote that in the case of no abnormality being detected. 



- 20 - 



CFM03244/P203-0384 



the process ..y return to step S801 «ltnout notifying 
It to the image reoording unit 214. 

in the description of the abnormality detection 
„ethod Shown In FIG. 9. an abnormality Is determined 
When difference between frames (change In an Image) Is 
above a predetermined value. However, the present 
invention Is not limited thereto, and other methods may 
be also used, such as a method determining an 
abnormality based on background difference of an Image. 
, ^ abnormality may be determined, using an external 
sensor such as an Infrared sensor, by detecting an 
abnormality signal from the external sensor. Any 

If When a schedule Is executed, 
method may be used only if. when a 

an abnormality can be detected based on abnormality 
,5 detection setting m FXG. llC which Is described later, 
and the Image storage and the ll>ce can be performed. 

FIG. 10 IS a flowchart showing processing to be 
performed In the camera control unit 217. After 
predetermined Initialisation (step S901,. a control 
co^d IS received (step S902,. If » Is a camera 
control termination re<r.est by the authorization 
^agement unit 218 (In the case of VKS at step S903,. 
then the connection management unit 220 Is caused to 
forcmgly closed the camera control connection (step 
25 S904). If It IS a camera control command (In the case 
of VES at step S905,. then a command Is Issued to the 
pan head control unit 216 when the request command Is 
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aete^mea to be a pan or tilt angle cononand fron, tbe 
content o^ the camera control .o^r... ana a con^ana Is 
sent to the l^age sensing unit 211 when the re-r^est 
co».ana IS aete^mea to he a .00. co™^« (step S90e,. 

the control co^^na acceptea at step S902 Is neither 
a camera control termination request nor a camera 
control co^nana. then the process proceeds to step S907 
ana performs processing corresponding to the control 
command . 

A scheaule m the first emboaiment Is now 
described. 

A scheaule IS set m advance In a form shown m 
PIG. IIA. A scheauler operates In accordance with the 
set scheaule. Each schedule shown In FIG. HA Is 
, compcsea of a schedule numher. starting time, ending 
time, authorization level, preset number, and 
abnormality detection condition setting number. The 
preset number maicates a combination of pan. tilt ana 
.00m values as shown In PIG. UB. ana the abnormality 
,0 aetectlon conaltlon setting number maicates various 
parameters such as a change threshold used for 
abnormality aetectlon ana a aetectlon area In an Image 
area as shown In FIG. UC When setting a scheaule. a 
time perloa aurlng which scheauled operation Is to be 
,S performed Is determined, and It Is specified what Image 
sensing conditions (for pan. tilt, and zoom, for 
example) and what abnormality detection parameters 
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xevex. It IS possible to set the levels o« terminals 
Which IS to he inhibited fro™ performing camera control 
during the scheduled operation. 

FIG. 12 is a flowchart showing scheduler 
processing operating In the schedule management unit 

in FIG. 12, in principle, an authorisation 
request Is Issued until the schedule management unit 
319 can acquire authorisation. «hen authorization Is 
„ acquired, the authorisation Is retained during the 
scheduled time period to perform a process of 
ehnormallty detection operation. As described above, a 
schedule IS registered within a scheduler of the 
schedule management unit 219 in a form of a table as 
,5 Shown m PIG. IIA. vmen the time matches the starting 
tl^e of any schedule In the table, a process for the 
schedule IS started, and the schedule setting of the 
schedule number of that schedule Is read In (step 
SlOOl). suppose that the authorisation level of the 
,0 read schedule In the table of FIG. HA Is Cn. the 

preset number. Pn. the abnormality detection condition 
setting number. Sn. and the schedule ending time. Tn. 
in this case, authorisation Is first re-r^ested to the 
authorisation management unit 218 at the authorisation 
,5 level cn. If the authorisation cannot be acquired (In 
the case of NO at step S1002,. the process waits during 
a predetermined time period Tl (step S1008, and then 
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returns to step S1002 to Issue a request again. The 
steps S1002. S1003 and S1008 are repeated until 
authorization can he aocpalred. However, if 

» i,.or. armiired hy the ending time 
authorization has not been aoqulrea y 

Tn the process ends. 

If authorization is acquired (in the case of VES 
at step S1003,. then camera control indicated hy the 

to Change the pan angle, tile angle and zoom of the 
, camera (step S1004,. Furthermore, the ahnormality 
aetectlon unit 213 is set based on the ahnormality 
detection condition setting number Sn in the table of 
PIG lie and the abnormality detection process shown In 
PIG. 9 IS started (step SIOOS). At step S1006. the 
, process waits until the ending time period Tn. At the 
ending time Tn. the ahnormality detection process Is 
stopped (Step S1007,. The scheduler process then ends. 

If the scheduled operation Is started when a 
terminal with an authorization level lower than the 
,0 scheduler holds the authorization, the authorization 

should be ta^en away from the terminal by the scheduler, 
on the contrary, authorization may be taKen away from 
.ne scheduler by a terminal with an authorization level 
higher than that of the scheduler. 

«hen the time Is not the ending time Tn. (in the 
case Of NO at step S1006). then the process waits 
during a predetermined time period T2. then determines 
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Whether or not tne authorization is stiil retained at 
step SIOIO. If the authorization is retained (in the 
case Of «S at step SIOIO). then the process returns to 
step S1006. If the authorization has heen taKen away 
,in the case of NO at step SIOIO,. then the scheduler 
returns to step SI002 to wait until authorization can 
he ac^ired again. When a higher authorization level 
terminal releases authorization, the scheduler ac-^ires 
authorization again to perform its scheduled operation. 
The ahnormality detection function automatically 
recovers in accordance with the schedule shown in FIG. 



IIA. 



25 



A Client program as shown in FIG. 13 operates on 
the terminal 12. The operation of the client program 

the Client program on the terminal 12 operates on the 
event basis in principle. When operation of the 

„ (VTG 4> or arrival of an image data 
operation screen (FIG. 4) or o 

^= «n event a process correspondent to the 
packet causes an event, «■ f 

event is performed. 

«hen activated with the address of the camera 
server device II to be connected specified, the client 
program sends the image display start revest command 
ot PIG. 5F to the corresponding camera server device II 
(Step SI202,. If no response is returned from the 
corresponding camera server device II (in the case of 
no at step SI203,. the process ends because there is 
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any operation abno^ality due to a »lstaK.n adaress and 
t^e li^e. If a response Is returned, the connection 
was successful (in tne case of VES at step S1203, , the 

(-hat- is a user operation 
process waits for an event, that is. a 

Of the user interface shown in FIG. 4 or a reception of 
an in^ge pacKet froa the camera server device II (step 
SI204,. and performs a process suitable for the event 

(step SI205) . 

FIG 14 is a flowchart showing examples of event 
and examples of the corresponding process performed at 

received at step S1204 is determined. 

vmen a user presses the authorization button 421 
Shown in FIG. 4. the camera control revest command of 
FXG 5A is issued to the camera server device II (step 
Siall). and the process waits for an authorization 
response (step SI212,. If an authorization response is 
returned, it means authorization has been acquired, and 
therefore a canera control connection to the camera 
server device II is established. The authorization is 
validated (step SI213) and operation of the camera 
control panel 42 is enabled (step S12I4,. If the 
authorization response is not returned, it means 
authorization has not been ac^ired. and therefore a 
camera control connection is not established. The 
process ends with the authorization left invalid. 



25 
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When the user presses the operation termination 
hutton after a camera control connection Is established, 
the camera control termination request command of PIG. 
5B is issued (Step S1221) to close the camera control 
connection. The authorization is invalidated (step 
S1222) to disable operation of the camera control panel 

42 (step S1223) . 

m.en authorization is taken away by a schedule or 
other client program with a higher authorization level, 
the camera control connection is forcedly closed by the 
camera server device 11. In this case, the 
authorization is invalidated at step S1231 to disable 
operation of the camera control panel 42 (step S1232). 

W>en operation of the camera control panel 42 is 
enabled, if a user operates the scroll bar 423. 424. 
425 or the button 426 to 429 of the PIG. 4. a camera 
control conm,and (PIG. 5C to 5E) corresponding to the 
operation is generated (step S1241) and issued to the 
camera server device 11 (step S1242, . The explanation 
of the process for generating the command is omitted 



20 

here. 



W>en the image data of PIG. 5H arrives, compressed 

at step S1251. then the i™age frame data is used to 
25 update the image displayed on the image display panel 
41 (step S1252). 
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I„ response to a client progran. termination 
request Issue* by operation of a menu an. t».e llXe. the 
image alsplay termination request command of FIC. SG Is 
issued (step S1261, and the client program ends (step 
S1262) . 

It Should be noted that for setting the 
authorization level not to 0 (lowest) hut to the 
administrator level (authorization level 2) at 
initialization of step S1201 In PIG. 13. the 
authorization level Is set to the administrator level 
and a password set via user Input Is specified to Issue 
a camera control start request at step S1202. 

AS described above, according to the first 
embodiment, the authorization level of a schedule 
5 including abnormality detection can be set. 

Accordingly, by setting a high authorization level for 
..e schedule. It Is possible to prevent other terminals 
trom taKlng away authorization while the schedule Is 
executed, and disable camera control by external 
,0 terminals other than a desired terminal. This solves 
the problem that abnormality detection for a monitored 
target Is disabled due to unexpected camera control 
performed by an undesirable terminal while a schedule 
IS executed. Furthermore, it Is possible to use a 
„ camera as a Web camera for delivering to an unspecified 
number of terminals during the day and as an 
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the scheduled operation. 

X„ tne *«st e».oa^ent. abnormality detection is 
,«r.o™e. m t.e scedulea operation, t.e embodiment 
.e also applied to t.e case w.e« — ^ - 
angle, tilt angle and .oom magnification are simply 
Id tbrougn aut.orl.atlon at a particular level .as^ 
on a scedule to record an l^ge. without detecting an 

abnormality . ^ 
Xn addition to tne case wbere particular pan angle, 
.lit angle and zoom magnification should be fixed 
aurmg schedule execution, it Is also possible to 
.peclfy an autborl.atlon level In tbe case «bere any 
aetected moving object, sucb as a suspicious person 
snould be automatically tracked by tbe camera server 



15 

device 11. 



;e 11. 

.ven If autborl.atlon Is taKen away by a blgber 
.utborl.atlon level terminal, tbe autborl.atlon 
automatically returns to tbe scheduled operation wben 
,0 tbe terminal releases tbe autborl.atlon. .bus. 
aeslred scheduled monitoring can be continued. 
[Second Embodiment] 

in tbe second embodiment. In addition to tbe 
features of tbe first embodiment, tbe scheduler Is 
controlled only from particular addresses, m the 
second embodiment, a schedule table as shown In «o 
IS used instead of that of FIO. -cept 
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i-xat only processings related to 
first embodiment, so that only P 

PIGS. ISA and 15B are described here. 

, ...horl.ed address .on. added ^^^'^ Z 
_ are the sa.e as those .^^ ^ ._l.ed 
FIG 15B is a table showxng entries 

a list Of addresses for 
The table shows a xxsx. 
rrdrconll IS permitted «hlle a „ed 

" — --^-:~^ltherthe 

corresponds to any address In the — 
,„„p IS added to the determination at step SSoe 

Xn this case, a list o. a„thorl.ed addresses .or 

..e schedule being executed Is read .rom the table n 
Z ISB step seos, the address o. the terminal 

FIG. addresses 
.eouestmg authorisation Is compared with 

\he list If the address does not correspond, 
on the list. .^is maxes It possible for 

20 authorisation IS not given. Th 

scheduler to accept camera control only from 
,„.lcular addresses during a particular time P lod. 

be surely prevented from being performed by 
control can be surely P , . „f the 

„ an undesirable terminal during the execution of 

schedule . 
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X„ t.is way. it is possible to prevent a camera 
.ein. controiXea ter^nais ot.er t.an a 
..eaetenninea te^ina. .urin. a pa^ticuia. operation 

the camera. 

r Other Embodiments! 

present invention can .e appXied to a systen, 
constitute* .y a plurality of devices or to an 
apparatus con^rising a single device. 

.urtner. t.e o.^ect o. tne present invention can 
...o .e aCievea .y providing a storage .ediu. storing 
p.ogra™ codes .or per.or»ing tne aforesaid processes 
, computer system or apparatus (e.g.. a persona 
computer,, reading tne program codes, .y a CPU or 

..e computer system or apparatus, fro™ tne storage 
. „edium. then executing the program. 

„ this case, the program codes read from the 
storage medium realize the functions according to the 
lolents. and the storage medium storing the program 
codes constitutes the invention. 
„ .urther. the storage medium, such as a floPpy ^s. 

. hard dis.. an optical dis.. a magneto-opt.cal drsK. 

CO-K. a magnetic tape, a non-volatile type 
memory card, and .CM. and computer network, such as^ 
„ocal area network, and WM. (wide area network,, can 
25 he used for providing the program codes. 

furthermore, hesides aforesaid functions according 
to the ahove emhodiments are realized .y executing the 
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.„vent.on .nc.u*es a case «.e« an OS (operate. 

p„t or entire processes in accordance wltn 
aesi,nations o. t.e pro.ra. co.es anareaXi.es 
functions according to tHe above embodiments. 

..rt„. tbe present invention aiso inciudes a 
case wbere. after tbe program codes read fron. tbe 

.edi^ are written in a .unction e^ansion card 
«bicn is inserted into tne computer or in a memor, 

provided in a .unction expansion unit wbicb is 
connected to tbe counter. CPU or tne iiKe contai^d ^ 
..e .unction e^ansion card or unit performs a p rt o 
entire process in accordance witb designations o. 
, ..ogra. codes and reaii.es .unctions o. tne above 
^^Tltsewberetbe present invention is appiied 
to tbe aforesaid storage .edium. tbe storage -ed.^ 
.tores Progra. codes corresponding to tbe .io«cbarts 
.0 sbown in Figs, e to iO and i2 described in tbe 

^'°r::esent invention is not ii^ted to tbe above 
.„.odi.ents and various cbanges and .odi.ications c„ 
.e n.de witbin tbe spirit «>d scope o. tbe pr sen 
invention. Tbere.ore to apprise tbe public o. tbe 
scope o. tbe present invention, tbe .oiiowing oiai^s 
are made. 



- 32 - 



